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I.  INTRODUCTION 


Binary  objects  arise  commonly  as  the  subjects  of  man-made  construction. 
Examples  are  a  page  of  print  and  its  variants  (handwritten  message,  license 
plate  on  a  "getaway"  car,  etc.),  pictures  in  dot  matrix  format  viewed  in 
closeup,  and  industrial  rods  of  known  material  viewed  in  a  tomographic  setup.* 
Alternatively,  a  user  might  want  to  reconstruct  a  multilevel  object  as  a 
binary  object  in  order  to  exaggerate  certain  features  such  as  edge  details. 

That  an  object  is  binary  represents  a  tremendous  amount  of  a  priori 
information,  something  that  greatly  aids  in  its  restoration.  A  further  aid  is 
that  often  the  user  knows  as  well  minimal  sizes  for  constituent  shapes  in  the 
object  scene.  For  example,  if  many  industrial  rods  (of  whatever  shape) 
comprise  the  object,  each  might  be  known  to  have  an  area  at  least  as  large  as 
value  A.  If  such  knowledge  can  be  built  into  the  restoration  method,  it  must 
also  improve  the  output  estimate.  Finally,  if  the  method  can  recognize 
strangely  located  points  on  the  periphery  of  the  object’s  constituent  shapes, 
and  place  them  in  more  regular  positions,  this  also  will  help.  He  report  next 
on  an  approach  that  incorporates  these  kinds  of  prior  knowledge. 


II.  SCENARIO 

We  adopt  the  notation  that  image  data 

Dataj.,  i-1 . Nfield; 

j«l,..., Nfield 

are  given,  and  that  the  point  spread  function  s(i,j)  is  known  to  a  good 
approximation.  For  simplicity,  the  space  Ax  between  rows  of  data  is  made 
unity,  as  is  Ay.  Quantity  i  is,  in  our  notation,  both  a  row  number  and  an  x- 
value,  and  j  is  a  column  number  and  y-value.  The  image  is  assumed  to  be 
formed  from  the  unknown  object  Objjj,  i*l , . . . ,Nf ield;  j-1 , . . . ,Nf ield  via  a 
convolution 


Nfield  Nfield 

Data(i,j)  -  Z  Z  Obj(k,m)s(i-k,  j-m)  +  Noise(i,j)  (1) 

k=l  ra-1 

for  all  (i,j).  The  objective  is  to  retrieve  the  Obj(k,m)  from  this  data. 
Every  value  Obj(k,m)  *  0  or  1,  since  the  object  is  binary.  We  picture  the 
object  scene,  then,  as  consisting  of  "grains"  of  intensity  1  placed  within  a 
field  of  Os.  How  can  the  grains  be  properly  placed  in  order  to  effect  a 
restoration? 


*B.R.  Frieden  and  C.K.  Zoltani,  "Maximum  Bounded  Entropy:  Application  to 
Tomographic  Reconstruction,"  Applied  Optics.  Vol.  24,  p.  201,  1985. 


III.  APPROACH 


Denote  the  grain  positions  ss  (X^,  X2i ,  1-1,...,  Npsrts)  where  1  denotes 
grain  number,  Xh  !■  that  grain's  row  position,  and^JCj*  Is  that  grain's  column 
position.  For  shorthand,  denote  theae  X-values  as  X  where 

X-  ((X^Y,)}*"1*  . 

The  total  number  of  grains  Npsrts  may  be  estimated,  from  (1)  ae 
Nfleld  Nf laid 

Nparts  -  E  I  Data  (l,j)  (2) 

1-1  J-l 

since,  by  normalization  of  spread  function  s,  the  right-hand  side  sums  to 

Nfleld  Nfleld  Nfleld  Nfleld 

I  E  ObJ(k,m)  +  E  E  Noise(l,J).  (3) 

k-1  ra-1  1-1  j-l 

Of  these  two  sums,  the  first  Is  exactly  Nparts,  while  the  second  should  tend 
to  be  small  compared  to  the  first  if  the  noise  is  zero-mean.  In  simulations 
using  Poisson  noise,  it  was  found  that  the  estimated  Nparts  value  very  well- 
approximated  the  true  value. 

With  Nparts  known,  the  following  algorithm  was  found,  after  much 
experimentation,  to  work  fairly  well  on  restoring  the  correct  X  (grain 
position)  values.  Start  with  an  initial  guess  at  X.  A  good  guess,  e.g..  Is 
the  Nparts  highest  Intensity  values  In  the  Data(i,j).  Since  the  object  1b 
binary,  this  is  often  a  very  good  guess.  For  example,  If  no  noise  were 
present,  an  object  consisting  of  a  single  round  shape  would  be  perfectly 
restored  by  this  Initial  guess!  (Such  Is  the  power  of  the  binary  assumption.) 

Next,  perturb  each  grain  position  independently  and  uniformly  randomly  ± 
Excurs,  where  Excurs  is  an  integer  input  number.  Motion  Is  allowed  in  both 
coordinate  directions.  For  example,  we  used  Excurs  -  20  when  the  Image  size 
was  Nfleld  -  64.  Accept  the  new  grain  position  If  (a)  it  was  unoccupied 
(keeping  the  object  binary),  and  (b)  image  inconsistency  (defined  below)  is 
reduced,  and  (c)  a  "clump”  penalty  Is  satisfied  (as  defined  below)  If  the 
penalty  is  turned  on. 

Image  Inconsistency  Y  is  defined  as 

Nfleld  Nfleld 

Y  -  E  E  [Run(i,j)  -  Data(i,j)]2,  (4a) 

i-1  j-l 

where  Run(i,j)  is  the  running  image  defined  as  convolution  of  the  running 
object  Abj(k,m)  with  the  point  spread  function 

Nfleld  Nfleld 

Run( i , j )  -  E  E  Abj (k,m)s( i-k,  j-m).  (4b) 

k-1  m-1 


r.'-TW.'  '.j  '.  u 


tj.  msa 


:TV~ 


The  running  object  Abj  is  the  updated  object  formed  from  X  with  the  possibly 
perturbed  grain  position  incorporated. 

Thus,  if  Y  is  decreased,  this  means  that  the  grain  in  question  was  placed 
in  a  position  that  is  more  consistent  with  the  iaage  data,  and  hence,  probably 
a  correct  object  position.  Therefore,  the  test  position  is  accepted,  and  X  is 
updated.  Next,  particle  number  1  is  incremented,  and  a  new  particle  is 
perturbed  in  position,  the  next  Y  again  tested,  etc. 

If  a  particle  fails  one  of  the  tests  (a)-(c),  it  is  left  at  its  given  X 
position,  and  the  next  particle  is  considered,  etc.  Once  particle  number  i  - 
Nparts  is  attained,  a  new  cycle  with  1“ 1  begins,  etc. 

The  algorithm  seeks  merely  to  minimize  Y  for  half  its  allotted  cycles. 

The  clump  penalty  is  turned  off  during  these  trials.  The  reason  is  that  small 
object  shapes  will  usually  not  be  present  in  the  initial  object  estimate,  as 
they  may  be  too  weak  in  intensity  to  be  counted  in  the  Nparts  highest  iaage 
values.  Therefore,  the  role  of  these  first  cycles  is  to  get  particles  out  to 
where  these  smaller  shapes  exist.  But  since  the  particles  are  perturbed  one— 
by-one,  they  will  (at  first)  be  Isolated  at  the  new  positions  required. 
Isolated  particles  violate  the  clump  penalty.  Hence,  it  must  be  turned  off 
during  these  cycles. 

The  clump  penalty  is  defined  as 
Nparts 

C  -  E  c.  ,  (5) 

i-1 


where 


1  if  particle  1  has  less  than  Nclump  nearest  neighbors 

ci  “ 

0  if  particle  1  has  at  least  Nclump  nearest  neighbors. 

The  nearest  neighbor  positions  for  a  particle  at  position  (x,y)  are  all  nine 
positions  (x±Ax,  y±Ay);  Ax  *  0,1,  Ay  -  0,1.  Nclump  is  an  input  parameter 
governing  the  size  of  the  minimal  object  shape.  A  value  Nclump  *  1 
effectively  turns  off  the  clump  penalty  since  any  particle  has  at  least  Itself 
as  a  nearest-neighbor.  Uhen  the  clump  penalty  was  turned  on,  values  Nclump  » 

3  or  4  were  used,  depending  upon  the  stage  of  the  cycle  number.  This  is 
described  next. 

After  half  the  specified  number  of  cycles  are  complete,  the  running 
object  usually  is  fairly  well  approximated.  Even  the  smaller  shapes  have 
particles  in  their  vicinity.  However,  some  particles  will  be  pushed  out 
randomly  to  near  the  margin  regions,  and  in  general,  many  isolated  particles 
will  exist.  At  this  point,  a  "merge"  operation  is  performed  whereby  each 
particle  that  is  isolated  is  merged  with  its  nearest  object  clump,  thereby 
satisfying  the  clump  constraint.  The  operation  is  as  follows:  (l)  each 
particle  is  tagged  as  being  either  Isolated  or  "clumped";  (2)  the  closest 
"clumped"  particle  to  a  given  isolated  particle  is  found;  (3)  all  unoccupied 
nearest-neighbor  sites  to  the  clumped  particle  are  found;  (4)  the  candidate 
unoccupied  location  that  would  reduce  Y  the  most  is  found;  and  (5)  the 


Isolated  particle  Is  placed  in  that  position.  The  particle  la  now  no  longer 
isolated.  The  next  isolated  particle  is  considered,  etc. 

The  cycling  as  above  now  proceeds  anew  using  Nclump  -  3  and  Excurs  -  5 
(reduced)  for  the  next  remaining  1/4  cycles.  Excurs  is  reduced  because  at 
this  stage  the  particles  are  presumed  fairly  near  their  correct  positions. 

The  total  penalty  used  is  now  Y+C.  Again,  only  particle  positions  are 
accepted  which  reduce  the  total  penalty.  This  keeps  the  particles  in  clumps 
of  at  least  size  3,  as  required,  while  further  reducing  image  inconsistency. 

Next,  during  the  last  1/4  cycles,  values  Nclump  -  3  (as  before)  and 
Excurs  -  3  (reduced)  are  used.  Excurs  is  so  reduced  because  the  particles  are 
presumed  even  closer  to  their  correct  positions  at  this  stage. 

Finally,  after  the  last  cycle,  a  "creep"  or  "touchup"  step  is  performed. 
This  step  is  meant  to  move  irregularly  placed  particles  on  the  contour  of  the 
object  shapes  to  more  regular  positions.  Although  these  particles  already 
obey  the  Nclump  -  3  constraint,  they  are  in  positions  which  give  the  contour  a 
very  high  degree  of  Irregularity  locally.  An  example  is  shown  in  Figure  1, 
where  point  A  it  a  candidate  for  "creep.”  Intuitively,  it  seems  Instead  to 
belong  at  the  unoccupied  (black)  site  to  its  lower  left,  completing  the 
triangle.  Interestingly,  this  intuition  can  be  quantified.  In  its  present 
position,  point  A  satisfies  Nclump  -  3  (just)  but  not  Nclump  ■  4.  On  the 
other  hand,  all  other  particles  shown  satisfy  Nclump  -  4  except  for  particle 
B.  Therefore,  particles  A  and  B  are  made  candidates  for  "creep."  This 
operation  moves  the  particle  to  the  neighborhood  of  the  closed  "clumped" 
particle  obeying  Nclump  -  4,  and  then,  into  the  nearest  neighbor  unoccupied 
site  to  the  clumped  particle  that  reduces  Y  the  most.  If  Y  can  only  be 
Increased  by  making  the  move.  It  Is  not  made.  The  effect  upon  Figure  1  is  as 
follows.  If  the  object  had  the  trlanglar  shape  shown,  then  moving  particle  A 
Into  the  black  site  would  reduce  image  Inconsistency.  Hence,  "creep"  will 
perform  this  move.  However,  no  move  of  particle  B  would  reduce  image 
Inconsistency.  It  already  is  in  the  right  place.  Hence,  "creep”  leaves  B 
where  it  was  (correctly). 

9  0  O  O  O 

O  O  O  O 

O  O  O 

o  o 
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Figure  1.  Binary  Object  Representation  and  Particle  Movement 


Figure  2.  Flow  Diagram  of  the  Deblurring  Algorithm 
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